Half quantum spin Hall effect on the surface of weak topological insulators 
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We investigate interaction effects in three dimensional weak topological insulators (TI) with an 
even number of Dirac cones on the surface. We find that the surface states can be gapped by a surface 
charge density wave (CDW) order without breaking the time-reversal symmetry. In this sense, time- 
reversal symmetry alone can not robustly protect the weak TI state in the presence of interactions. 
If the translational symmetry is additionally imposed in the bulk, a topologically non-trivial weak 
TI state can be obtained with helical edge states on the CDW domain walls. In other words, a CDW 
domain wall on the surface is topologically equivalent to the edge of a two-dimensional quantum 
spin Hall insulator. Therefore, the surface state of a weak topological insulator with translation 
symmetry breaking on the surface has a "half quantum spin Hall effect" , in the same way that the 
surface state of a strong topological insulator with time-reversal symmetry breaking on the surface 
has a "half quantum Hall effect" . The on-site and nearest neighbor interactions are investigated in 
the mean field level and the phase diagram for the surface states of weak topological insulators is 
obtained. 

PACS numbers: 73.20.-r, 72.25.Mk, 71.45.Lr 



I. INTRODUCTION 

Topological insulators (TIs) have recently attacted a 
lot of interest in the condensed matter physics com- 
munity due to its fundamental novelty and potential 
appHcationi"— . Unlike normal insulators, TIs possess 
gapless modes with linear Dirac dispersion at the edge 
or surface as a direct physical consequence of the bulk 
topology and the time reversal symmetry. TIs have been 
realized in both two dimension, such as HgTe quan- 
tum wells^^^, and three dimension, including Bii-a^Sb^;/^, 
BisSes family^i^ and TlBiSes family ^^^^ Within the 
non-interacting band theory, it is proposed that the TIs 
can be further classified into two classesi^"— , one is the 
strong TI, which possesses odd number of Dirac cones at 
the surface and has been realized in experiment as men- 
tioned above, while the other one is the so-called weak 
TI, which has even number of Dirac cones. The weak TI 
is topologically equivalent to a stack of two dimensional 
TI (quantum spin Hall insulator) and is unstable against 
the translation breaking term — . It is also proposed that 
one dimensional helical liquid can exist along the dislo- 
cation line of the lattice in a weak TI, which is believed 
to be protected by time reversal and stable against the 
weak disorder— Recently, it is predicted that weak 
TI surface states are stable under time-reversal-invariant 
disorder^^^^^. 

In the presence of interactions, the strong TI can be 
defined in terms of the topological field theory^^ with 
a quantized axion angle of ^ = tt. Since the bulk ax- 
ion topological term can be expressed in terms of the 
Chern-Simons term on the surface, the axion angle of 
= IT implies a "half quantum Hall effect" on the surface, 
when time reversal symmetry is broken on the surface but 
preserved in the bulk. The half quantum Hall effect is 



responsible for the topological magneto-electric effect of 
the strong TI^^. The time reversal symmetry breaking 
on the surface can be realized by Ising type magnetic 
moments oriented along the surface normal. A single 
chiral mode exists on the domain wall of the magnetic 
moments. Strong TI can be generally defined this way 
as long as the time reversal symmetry is present inside 
the bulk, without specific reference to the translational 
symmetry of the lattice and the periodic band structure. 
However, weak TI is not generally robust when only time 
reversal symmetry is present in the bulk, in fact we shall 
show that it is possible to open up a gap on the surface 
without breaking the time reversal symmetry. Therefore, 
lattice translation symmetry must also be imposed in the 
bulk for the weak TI to be topologically well defined. In 
this case, it is natural to ask what is the physical effect 
associated with breaking the translational symmetry on 
the surface of a weak TI. In this paper, we investigate 
interaction effects in weak TI by first writing a minimal 
four band model for weak TIs. Then we show that the 
weak TI phase, possessing two Dirac cones at the (0, tt) 
and (tt, 0) of the surface Brillioun zone respectively, can 
be obtained by properly tuning the parameters of the 
four band model. The surface staggered potential ((tt, tt) 
charge density wave) can induce the scattering between 
the two Dirac cones and gap the surface states without 
breaking time reversal symmetry. Interestingly, a helical 
liquid, identical to the edge states of the 2D topological 
quantum spin Hall insulator—*^, emerges at the domain 
wall for the staggered potential. Consequently, the gaped 
surface state of weak TI can be regarded as a half quan- 
tum spin Hall state, in analogy to the half quantum Hall 
state for the gaped surface state of strong topological in- 
sulators. We propose such a "half quantum spin Hall 
effect" as a robust defining feature of weak TI. Since the 
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quantum spin Hall state is stable upon electron interac- 
tion, so is the half quantum spin Hall effect. As long as 
the translation symmetry in the bulk is preserved, the 
weak TI is a well-defined topological state defined by the 
helical liquid on the domain wall of a surface CDW or- 
der. To find the condition for the surface CDW order, we 
further investigate the effect of repulsive interaction for 
the surface states of weak TIs. Our results show that the 
surface CDW state with half quantum spin hall effect is 
realized when nearest neighbor repulsion dominates the 
on-site repulsion, while a ferromagnetic quantum anoma- 
lous Hall state is induced in the opposite limit. We find 
the surprising result that the antiferromagnetic order is 
not favored by the on-site repulsion on the surface of a 
weak TI, in sharp contrast to conventional 2D systems. 



II. HALF QUANTUM SPIN HALL STATE 

The four band model introduced by Zhang et al has 
been successfully used to describe the strong topological 
insulator of Bi2Se3 family of materials^. For simplicity, 
we use the tight-binding regularization to re-write the 
four band model in the cubic lattice 

k 

H{k)=M{k)Ts^A r,sin/c, (1) 

i=l,2,3 



6B — 2B ^ . cos , Fi = cTi (g) Ti , 
c^s r4 = 1 (g) r2 and F5 = 



where Mik) = Mq 

r2 = (72 Ti , F3 

1 (g) Ta. Here Mq, B and A are model dependent param- 
eters, and for simplicity, we take B > {). We consider 
two orbitals, as well as spin, so that the field operator 
V^(k) = [ca,t, C5,^, Ca,|, h.iV ^ Orbital indices). 

Pauli matrices a denote spin and r denote orbital. The 
model is assumed to be isotropic and preserve inversion 
symmetry P = 1 (g) ra. Due to the inversion symme- 
try, the Z2 topological nature of the system can be eas- 
ily extracted from the parities of the occupied states at 
the time reversal invariant points according to Fu-Kane 
criterion^^. There are totally eight time reversal invariant 
points in the whole 3D Brillioun zone (BZ), denoted as 
Ai = {hzi^ /^2, ^3) = 1 . . . 8) where ^^1,2,3 = or tt. The 
parities of the occupied bands can be easily obtained from 
the sign of the mass term A^(k) for the above Hamilto- 
nian ([1]), denoted as Sa. = —sgn (A1(k = A^)). Then the 
strong TI Z2 index is defined as^^- 



and three weak TI Z2 indices are given by 

(-1)'''= = n«;,=^(5(«,,^,,«3). 



(2) 



(3) 



The strong TI index is determined by the product of the 
parities of all the eight A^ point in BZ while the weak TI 
index is given by the product of the parities of the four 



Ai in the tvk = ^ plane {k = 1, 2, 3). With the above defi- 
nition, the topological property of the Hamiltonian ([1]) is 
determined by {uq; i^ii^2^3), and we find the following dif- 
ferent parameter regimes for the system. When Mq > 
or Mo < —125, the system is a trivial insulator with the 
Z2 index {uo; iyiiy2J^3) = (0;000); when > Mq > -45 
or —SB > Mq > —125, the system shows the strong 
TI phase with the Z2 index (1;000) or (1; 111); when 
—45 > Mo > —85, the system stays in the weak TI 
phase with Z2 index (0; 111). Since here we are only in- 
terested in the weak TI phase, we focus on the parameter 
regime -45 > Mq > -85. 

To investigate the surface state of weak TI, we consider 
the Hamiltonian ([1]) in a semi-infinite configuration (only 
z < region) with open boundary condition at 2: = 0, so 
that the surface is normal to (100) direction (z direction). 
It should be noted that the detailed form of surface state 
for weak TI will depend on the direction of the surface. 
The surface states can be calculated numerically with 
the iterative Green function method^^ and the obtained 
surface local density of state is shown in Fig [TJ In the 
regime —45 > Mq > —85, it is found that there are 
two Dirac cones, located at Qi = (tt, 0) and Q2 = (0, tt) 
of the surface BZ. At the momentum Qj (j=l,2), the 
eigen states of the Hamiltonian ([1]) can also be solved 
analytically with the eigen wave function given by 
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(4) 



where pn = {fix^riy), a denotes spin index and N is the 
normalization factor. The spin part of the wave function 
is given by 



^0 



^0 



(5) 



with ^j, = -^[i, The z-direction wave function takes 
the form ip{nz) ~ aiX^' + 02^2^ where Ai,2 are the two 
solutions of the equation 
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(A - A-i) +M0 + 6B- B{X + A"^) = 0. 



(6) 



It is found that only in the regime —45 > Mq > —85, 
Ai^2 will satisfy |Ai^2| > 1, hence a normalizable wave 
function {z ^ —oo limit) exists, which agrees with the 
parity criterion discussed above. With the eigen wave 
function of the surface states, we project the Hamiltonian 
([1]) into the sub-space spanned by ^q^. , which can be 

done by expanding the operator ?/^(n) as 



Vi(n) ^ ^^^^.(pn,n^)c^-,a(Pn) 



(7) 



where the new operator Cj^cr{pn) is assumed to slowly vary 
with pn. Substituting ([7|) into ([1]), we find the effective 
Hamiltonian for the surface state 



H —A 



cr2(8)T3 + fcs;Cri(8)T3)*(A), (8) 
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FIG. 1: (a) The surface dispersion with two Dirac cones at 
(0,7r) and (tt, 0); (b) the local density of states at the surface 
BZ at the energy E — 0.3. Here we take A — 1, B — 1 and 
Mo = -5. 

with "^^(r) = (cj ^, ^, |). Here a and r denote 

Pauli matrices in spin and the two Dirac cones at (5i,2 of 
the surface BZ. This Hamiltonian satisfies time reversal 
symmetry T = QK with O = iay 1 and K complex 
conjugation. 

The next question is which kind of scattering can open 
a gap for the surface states without breaking time re- 
versal. With a single Dirac cone, it is found that the 
two components are related to each other by time rever- 
sal symmetry, therefore it is not possible to open a gap 
without breaking time reversal by the scattering within 
a single Dirac cone. Consequently, we need to consider 
the scattering between two Dirac cones, as shown in Fig 
[2] (b). The only mass term which can gap both Dirac 
cones while preserving time reversal symmetry is 

Hi= D J d^r^h (g) n^. (9) 

To identify the physical meaning of i^i, we can re- 
write this term in the lattice model and obtain the form 
Hi = D^^{-l)^''~^yc^{n)c{n), which is nothing but 
the staggered potential (or (tt, tt) charge density wave) 
at the surface. The staggered potential breaks transla- 
tion symmetry, enlarges the lattice unit-cell and reduces 
the surface BZ. In the new surface BZ, as shown by the 
dashed line in Fig[2](b), two Dirac cones can be related 
to each other by the reciprocal lattice vector, therefore 
they actually correspond to the same point and can be 
gapped in the reduced BZ. Thus the weak TI requires the 
protection of translation symmetry and can be adiabati- 
cally connected to the normal insulator if the translation 
symmetry is broken. 

However there is still a non-trivial physical conse- 
quence for the gapped system. For the surface staggered 
potential, there are two possiblilities, as shown by the left 
side and right side of Fig [2] (a), which are related to each 
other by a shift of one lattice constant and correspond 
to the mass term D > and D < in the Hamilto- 
nian dnj, respectively. Now the surface states are de- 
scribed by Dirac equations, and when a mass domain 
wall forms between two possible staggered potentials. 



zero modes are expected to emerge at the domain wall, 
as shown in Fig [2] (a). To see this, we consider a mass 
domain wall along x direction, namely D{x) = Dq > 
when X > and D{x) = —Dq < when x < 0. At 
ky = point, the eigen equation for the zero modes (with 
zero eigen-energy) reads dxi^ix) = D{x){(j2 ^ r2)V^(x), 
which leads to the normalizable domain wall solution 
Aipsix) = ^e~^ol^l/^^s_ {s = ±), where N is normal- 
ization factor and (_st is the eigen-state of ((72 <S) T2) with 
(cr2(^T2)^st = t(^st- s = ± denotes the additional degener- 
acy for the solution V^s(x) and because [<Ji (8)T3, <J2 (8)T2] = 
0, we can take (^st also as the eigen-state of cji (g) ra with 
(cri(g)r3)^st = s£^st' Because T(cri(g)r3)T"^ = -(ai^rs), 
(cTi (g) T2)TU = -T{(Ji (g) T2)U = -sT(^su which indi- 
cates that and are two Kramers' partners. We 

can project the Hamiltonian (|8|) with nonzero ky into 
the subspace spanned by V^±(x) and obtain the effective 

Hamiltonian H^d = A^^^ (c^ kyC-^ c_kyC- 1 where 

c± and denote the annihilation and creation operator 
for the zero modes ip±{x). From the form of the effective 
Hamiltonian, the zero mode solution at the mass domain 
wall is exactly the helical liquid, consisting of only one 
left mover and one right mover, which are related to each 
other by time reversal, identical to the edge states dis- 
covered in the 2D quantum spin Hah state^^^. A direct 
numerical calculation of the surface states with the mass 
domain wall exactly gives the above physical picture, as 
shown in Fig [2] (c). Here we can furthermore make the 
analogy to the surface state of the strong TI. When the 
top and bottom surfaces of a strong TI slab are covered 
by magnetic materials with the magnetization direction 
as shown in Fig. 14 of Ref.^^ and reproduced here in 

Fig [3] (a), the system has one chiral edge mode and ex- 

2 

hibit the Hall conductance of ^ . Since two surfaces con- 

2 

tribute equally to the ^ Hah conductance, each surface 
is expected to contribute half of the Hall conductance 
1^, leading to the so-call half quantum Hall effect ^^^5^. 
Here similarly, consider the weak TI slab sandwiched by 
two (tt, tt) charge density wave materials, then the system 
will become a quantum spin Hall insulator with a helical 
mode along the edge, as shown in Fig [3] (b). Again the 
top and bottom surfaces contribute equally to the quan- 
tum spin Hall insulator, consequently we can regard one 
surface state as a half quantum spin Hall state. 



III. INTERACTION EFFECT 



In this section we hope to investigate the effect of the 
interaction on the surface states of weak TI within the 
mean field approximation. Here the on-site and nearest 
neighbour interaction are taken into account, with the 
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FIG. 2: (a) Two possible staggerd potentials at the surface 
of weak TI. The dashed line shows the position of the domain 
wall of the staggered potential with a helical liquid along the 
domain wall, (b) The surface BZ and the reduced surface BZ 
(dashed line) when there is staggered potential, (d) The band 
dispersion of the system when there is a staggered potential 
domain wall. 
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FIG. 3: (a) Schematic plotting of the quantum anomalous 
Hall insulator with Hall conductance /h formed by a strong 
topological insulator sandwiched by two ferromagnetic mate- 
rials at two surfaces, therefore one surface contributes half 
quantum Hall conductance, (b) In contrast, when the weak 
topological insulator is sandwiched by two materials with op- 
posite charge density wave at the two surfaces, a quantum 
spin Hall insulator is formed. Consequently, we can regard 
one surface as half quantum spin Hall state. 



form 



n,r) 



Y,cU)Cr,.(i). (10) 



r](7 



where rj = a^b denotes orbitals and a =t, i denotes spin. 
Hu and Hy can also be projected into the sub-space of 
the surface states by the expansion ([7j) for the operator 
?/^(n), and the obtained Hamiltonian is given by 

Hu = U (Pr [(^Vo (8)ri^)(^Vo (g)ri^) 

i=0,l 

-(^Va ri^)(^V3 (g) Ti^)] (11) 
Vi'^\r)ao (8) ro^(r)^'^(r)ao (8) ro^(r) 



H 



-V2'^Hr)cro 8) ri'^{f)'^\f)cro (g) ri^(r) 



(12) 



where U ■ 



UNi 



, Vi = V{N2 + 2Ni), V2 = V{2Ni - N2), 

Ni = E„. and N2 = Ei. mz)4>{i. + I)?- 

We can treat the interaction Hamiltonian (pTj) and ([12]) 
in the mean field level and need to take into account the 
following order parameters 



D = (^Vo (8)ri^), 



m 



(^■•■a^ro^), 



(13) 



Here fa and S are the order parameter of (tt, tt) charge 
density wave, ferromagnetism and anti-ferromagnetism, 
respectively. The mean field Hamiltonian is given by 

Hu = U J dPr [2n(^Vo (g) tq^) - 
+2i:>(^Vo n^) - D'^ - 2m3(^V3 (8) ro^) 



253(^^3 0ri^) + 5|] 
V |Fi [2n(^Vo (8) ro^) - 
V2 [2I)(^Vo0ri^)-I)2]}, 



+m3 



(14) 



(15) 



with the density n = (^'''^). 

The phase diagram of the system can be obtained by 
minimizing the total free energy 



F = Hsur^Hu^Hv-^i j dV^t^ 



(16) 



The last term gives the chemical potential which deter- 
mines the density n, and when the chemical potential is 
at the Dirac point of the surface states, the density n is 
taken to be zero. 

Next let's analyze the possible non-trivial phase in- 
duced by the interaction Hamiltonian Hu and Hy. First 
we only consider the nearest neighbour interaction Hy. 
From Eq. ([15]), we can see that V2 term prefers (7r,7r) 




charge density wave. By minimizing the free energy, we 
obtain the self-consistent equantion 
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V2 



+ (2V2DY - J2iinA^ + (2V2DY (17) 



with the high energy cut-off A. For the above equation, 
a self-consistent solution only exists when V2 > V2c = 
——^^=—-. When this condition is satisfied, there is 

2(A— V27rn) ' 

(tt, tt) charge density wave in the system, which induces 
the half quantum spin Hall state. 

For Hu^ the situation is a little more complicated 
since there are three different order parameters: ferro- 
magnetism ma, anti-ferromagnetism Ss and charge den- 
sity wave D. Charge density wave D has been discussed 
above and here we focus on the competition between the 
ferromagnetic order ms and anti- ferromagnetic order 83. 
Interestingly, we find that the ferromagnetic order ms 
will induce a gap of the system but the anti- ferromagnetic 
order S3 can not. Consequently we expect that the ferro- 
magnetic order will win, which is different from the usual 
two dimensional electron gas where the on-site Hubbard 
interaction will induce the anti- ferromagnetic order. In- 
deed, the minimum of the total free energy is determined 
by the self-consistent equations 



^\/A^A^ + {2Ums)^ + 2Ums j , ^3 = 0. (18) 

Non-zero ferromagnetic order requires U > Uc = 
In such case, the time reversal symmetry is sponte- 
nously broken and the ferromagnetic order open a gap 
for each Dirac cone separately. Since each Dirac cone 

will contribute half quantized Hall conductance when it 

2 

is gapped, the surface state has Hall conductance ^. 

Now let's discuss the coexistence of the on-site and 
nearest neighbour interaction, where the ferromagnetic 
order ms will compete with the charge density wave order 
D. In such case, we only consider the competition of 
these two orders and obtain 



27rm3 
27tD 



E 



t=± 



2m3U + 2W{V2 - U) 
/(m3,D) 



A2 



E 



2tmsU ^2D{V2-tj) 



(19) 
(20) 



with fims.D) = yjA^A^ + (2m3/7 + 2tD{V2 - Uf) + 

\2msU + 2tD{V2 — U)\. The equations can be solved nu- 
merically and the phase diagram is shown in Fig. HI The 
system remains in the semi-metal phase for the small 
U and V. When U is increased, there is a continous 
phase transition to the ferromagnetic order with quan- 
tum anomalous Hall effct, while when V is increased, 
there is a phase transition to the charge density wave 
order with half quantum spin Hall effect. When U and 
V coexist, there is a first order phase transition. This 
picture is quite similar to the interaction effect in the 
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FIG. 4: The phase diagram for the interacting surface states 
of weak TI. Here we take Ni = 1 and A^2 = 0. U and V are in 
the unit of (I) semi- metal regime; (II) ferromagnetic and 
quantum anomalous Hall regime; (III) charge density wave 
and half quantum spin Hall regime. 



honeycomb lattice^^, and the non-trivial thing here is 
that the charge density wave can induce half quantum 
spin Hall effect. 



IV. DISCUSSION AND CONCLUSIONS 

As a summary, we investigate interaction effects for 
the surface states of the weak TI and the related phase 
diagram. We show that the weak TI can be topolog- 
ically robust if we supplement time reversal symmetry 
with translational symmetry in the bulk. Helical modes 
exist on the domain wall of CDW order on the surface 
and the associated "half quantum spin Hall effect" of 
the surface can be used as a general defining physical 
property of the weak TI. This provides one example of 
that the symmetry breaking inducing non-trivial physi- 
cal phenomena. Recently, several papers21i2^ discuss the 
disorder effect of the weak TI and show that the weak 
TI is robust against the time reversal invariant disorder. 
This is consistent with our results here because in their 
case, the translation symmetry is not broken macroscop- 
ically after taking the average of the disorder, while in 
our case, the charge density wave breaks the translation 
symmetry macroscopically which induces a band gap for 
the surface state. Moreover, we conjecture that the weak 
anti-localization for the surface state of weak TI under 
the time reversal invariant disorder can also be under- 
stood as a consequence of the half quantum spin Hall 
effect we studied. Consider the clean surface with CDW 
order, and turn on non- magnetic impurities. The dis- 
order will pin different CDW domains around different 
spatial points, leading to random CDW domain walls on 
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the surface. There is a pair of hehcal edge states propa- 
gating along each domain wah. With random impurities, 
the area of the two types of CDW domains are always 
equal on average, so that the edge channels are always 
conducting due to percolation. 

Finally, we remark on the possible material realiza- 
tion of the weak TI. The only known material exhibiting 
non-trivial weak TI index is Bii-a^Sb^; alloy^^^^^, which 
also has non-trivial strong TI index. Consequently, if a 
charge density wave order is introduced on the surface of 
Bii_a;Sba;, the surface will become a half quantum spin 
Hall state coexisting with an additional massless Dirac 
cone from the strong TI index. The weak TI phase is 
also proposed recently for the 1/6 and 2/3 filling frac- 
tions in the octahedron-decorated cubic lattice^^. Search 
for new weak TI materials will be another interesting 
question for the future research. We also notice a recent 



paper with a related but different proposal that charge 
density wave can also induce quantum spin Hall effect in 
some 2D systems^^. 
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